Model Selection

6-bit quantization

# 6-bit quantization

Deepseek R1 0528 Qwen3 8B 6bit

A 6-bit quantized version converted from the DeepSeek-R1-0528-Qwen3-8B model, suitable for text generation tasks in the MLX framework.

Large Language Model

Devstral Small 2505 MLX 6bit

A lightweight language model developed by mistralai, optimized with 6-bit quantization via the MLX framework, specifically designed for Apple Silicon.

Large Language Model Supports Multiple Languages

lmstudio-community

Josiefied Qwen3 4B Abliterated V1 6bit

This is a 6-bit quantized version of the Qwen3-4B model converted to the MLX format, suitable for text generation tasks.

Large Language Model

Dia-1.6B-6bit is a 6-bit quantized version based on Dia-1.6B, optimized for the MLX framework as a text-to-speech model.

Speech Synthesis English

Gemma 3 27b It Qat 6bit

This is a quantized version based on the Google Gemma 3 27B model, supporting 6-bit quantization and suitable for image-text to text tasks.

Transformers Other

Featured Recommended AI Models

AIbase

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご

© 2025AIbase